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RELAXATION PATTERNS AND SEMI-MARKOV DYNAMICS 


MARK M. MEERSCHAERT AND BRUNO TOALDO 


Abstract. Exponential relaxation to equilibrium is a typical property of 
physical systems, but inhomogeneities are known to distort the exponential 
relaxation curve, leading to a wide variety of relaxation patterns. Power law 
relaxation is related to fractional derivatives in the time variable. More general 
relaxation patterns are considered here, and the corresponding semi-Markov 
processes are studied. Our method, based on Bernstein functions, unifies three 
different approaches in the literature. 
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1. Introduction 


Relaxation phenomena in complex systems can deviate from the traditional ex¬ 
ponential model. In a heterogeneous system, a linear combination of exponential 
curves with varying rates can lead to power law relaxation, or a variety of other 
forms. Power law (Cole-Cole) relaxation and Havriliak-Negami relaxation (tran¬ 
sitioning between power laws frequency changes) are commonly seen in complex 
materials, including polyrners. disordered crystals, supercooled liquids, and amor¬ 
phous semiconductors HI; El]- The connection between relaxation and con- 


M\. 


In the CTRW 
n, and the 


tinuous time random walk (CTRW) models is reviewed in 
model, particle motions A„ are separated by random waiting times W, 
long-time limiting particle density solves an evolution equation that incorporates 
the relaxation curve. One famous example is the fractional Fokker-Planck equa¬ 
tion for subdiffusive particle motions in a potential well, where delays in particle 
motion caused by sticking or trapping with a power-law distributed waiting time 
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lead to a fractional time derivative in the evolution equation for particle density 


[H [ii [13 Si [s^- More general waiting time distributions lead to a variety of 
pseudo-differential operators in time [35| that model general relaxation patterns. 


This paper applies the theory of Bernstein functions to unify the three main 
approaches to relaxation modeling, exemplified by the work of Meerschaert and 
Scheffler [Hj , Toaldo [Hj , and Magdziarz and Schilling [HI . We show that all three 
approaches are equivalent, and we establish the correspondence between model 



equations using conjugate Bernstein functions M . We establish some properties 


of solutions using regular variation theory mi , and extend to semi-Markov 


(CTRW) particle models. The forward and backward Kolmogorov equations for 


Markov processes on a discrete state space are generalized to the semi-Markov case, 
and the classification of states into transient or persistent is discussed. More gen¬ 
eral evolution equations, solved by time-changed (relaxed) semigroups on a Hilbert 
space, are also considered. 

2. Relaxation patterns 

2.1. Some basic facts on Bernstein functions and subordinators. In order 
to go on with the results we need some theory of Bernstein functions and subordi¬ 


nators. We recall here some basic facts (see Bertoin i[i3; Schilling et al. [i^ for 


more details). A Bernstein function / : (0,oo) ^ [0,oo) is defined to be of class 
C°° and such that (-I)"" > 0 for all n e N := {1, 2, 3,...}. A function / 


\ / t/ V. / __ — i / / J 

is a Bernstein function if and only if [491 Thm 3.2] it can be written in the form 



( 2 . 1 ) 


where a and b are non-negative constants and u(-) is a a-finite measure on (0, oo) 
such that the integrability condition 



( 2 . 2 ) 


is fulfilled. The triplet (a, 6, u) is said to be a Levy triplet. An integration by parts 
of (12.11) yields 



where u(s) = a -I- z/(s, oo). It follows from [i^. Corollary 3.7 (iv)] that (12.31) is a 
completely monotone function i.e. it is C°° and such that 


jn 

(-1)”^ (</'"V(</')) > 0, for all n e N. 


(2.4) 


A particular subset of Bernstein functions is the set of special Bernstein functions. 
A Bernstein function / is said to be special if = 4^/ fi'P) is again a Bernstein 


function. The function /*, which is also special, is said to be the conjugate of / 
and has the representation 



(2.5) 







where [i^ p. 93] 
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b* 


a+^'(0,oo) ’ 


b > 0, 

6 = 0 , 


^+/o“ tu(dt) ’ 


a > 0, 
a = 0. 


( 2 . 6 ) 


In what follows we will also need complete Bernstein functions. A Bernstein func¬ 
tion / is said to be complete [i^ Def 6.1] if the density iy{s) of the Levy mea¬ 
sure h'{ds) = v(s) ds appearing in (12.11) is a completely monotone function. Ac¬ 
cording to [i^ Thm 6.2, (ii)] we have that a Bernstein function / is complete 
if and only if ^ is a (non-negative) Stieltjes function i.e. a function 

h : (0, oo) —^ [0, oo) which can be written in the form 


H4>) “ T + ^ + 

9 



1 

4> + s 


s{ds) 


(2.7) 


where s is a measure on (0, oo) such that 


(1 -I- s) ^s{ds) < oo. 


( 2 . 8 ) 


It is also true that / is complete if and only if the conjugate f*M = (f’/fW is 
complete, and hence every complete Bernstein function is special Prop 7.1]. 

Bernstein functions are naturally associated with subordinators which are non¬ 
decreasing Levy processes. The one-dimensional distributions of a subordinator 
form a convolution semigroup of sub-probability measures, i.e., a family of sub¬ 
probability measures {/rt(-)}t>o supported on (0,oo) such that 

(1) //t(0,oo) < 1, 

(2) fdt* fig = /Tt+s for all s, t > 0, 

(3) fit —> 6o vaguely as t —>• 0, 

and 


/:[^,(.)](0) = (2.9) 

where is a Bernstein function. We will denote by {t), t > 0, the subordinator 
with Laplace exponent /. If / is a special Bernstein function then the corresponding 
subordinator is also said to be special. The following facts will be used throughout 
the paper. A subordinator is special if and only if Thm 10.3] its potential 
measure 

pOO 

U'^^dt) := E / l{af{s)Gdt}ds = c6o{dt) -\-u^f{t)dt (2.10) 

^0 

for some c > 0 and some non-increasing function u„f : (0, oo) —>■ (0, oo) satisfying 
u{t)dt < oo. In particular from [d^, Corollary 10.8] we know that if 6 = 0 and 
1 ^( 0 , oo) = oo then c = 6* = 0, i^*(0, oo) = oo, and 


u^f{t) = a* + =ii*{t). 


( 2 . 11 ) 


2.2. Rel 2 Lxation patterns. Meerschaert and Scheffler develop limit theory for 
the continuous time random walk (CTRW) model from statistical physics. Given 
an iid sequence of jumps Jn and an iid sequence of waiting times Wn, a particle 
jumps to location Sn = Ji + ■ ■ ■ + Jn at time T„ = VLi -I- • • ■ -I- Wn- Given a 
convergent triangular array of CTRW models, they show Theorem 2.1] that 
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the limit process is of the form X{L-f(t)) where X{t) is the limiting Levy process 
for the random walk of jumps, time changed by the inverse subordinator 

L-^{t) = inf {s > 0 : (s) > t} , ( 2 - 12 ) 

where <J^(t) is a Levy subordinator with Laplace exponent /, so that = 

g-t/( 0 ) for all t > 0. Kolokoltsov 271 extended the model to a Markov process 
limit X{t) by allowing the distribution of the jumps Jn to vary in space. In both 
cases (under some mild conditions, see [s^ Theorem 4.1] and 27, Theorem 4.2]) 
the probability densities p(a:, t) of the CTRW limit solve a governing equation 

Cf{dt)pix, t) = Ap{x, t) (2.13) 

where A is the generator of the Markov semigroup, and the Caputo-like operator 
Cf{dt)u{t) = C~^ [f{(j))u{cj)) - (j)-^f{cj))u{0)] (t), (2.14) 


see [3a, Remark 4.8]. If the waiting times Wn belong to the domain of attraction 
of a stable subordinator with Laplace exponent /(</>) = (j)^, then (I2.13P specializes 
to 

dtP{x,t) = Ap{x,t) 

where is the Caputo fractional derivative 
lead to distributed order Q and tempered [sHlS 


(2.15) 

Eq. (2.16)]. Other choices of / 
I fractional derivatives. 


Toaldo Eq. (2.18)] introduced the operator 

V^u{t) = b^u(t) + - 7 - / u{s)v{t — s)ds 
dt dt J Q 


(2.16) 


where u(s) = a + u(s, 00 ) for a Levy triplet (a, 6 , z/), and where s —>■ u(s) is assumed 
to be absolutely continuous on (0,oo). The operator (I2.16|) can be regularized by 
subtracting an “initial condition”, as in Remark 4.8], resulting in a generalized 
Dzerbayshan-Caputo derivative 

d d 

D{u(t) = b—u(t) + — / u(s)D(t — s)ds — D{t)u(0). (2-17) 

dt dt J Q 

Use (|2.3|1 to compute the Laplace symbol of (|2.17|) as 


D{u{t) {(/)) = b(jm[(j)) — hu{{)) + (j)C[u * v] (^) — 


(M. 

\ <t> 


— b I m( 0 ) 


= b(j)u{4>) - bu{0) + 4>u{4>) -b^ - ~ ^ 

= f{4>)u{4') - ((>" V(<(>)“( 0 ). (2.18) 

This shows that (I2.14|) and (|2.17l) are the same operator at least for continuously 
differentiable functions u: indeed the Laplace transforms agree and t —>■ '£s{u{t) is 
a continuous function since by ^ Proposition 2.7] we can write 

d d 

D{u{t) = b—u{t) + — / u{s)i'{t — s)ds — P{t)u{0) 
dt dt J Q 


d 

= b—u{t) + / u'{s) v{t — s) ds 
dt Jo 


(2.19) 


and therefore is continuous, since u' and u are continuous, hence also u' * v. 

Hence (12.171) provides an explicit definition of the operator C/ in (I2.13p . 


























5 


A third approach was adopted in Magdziarz and Schilling [^ : The authors 
pointed out that the distribution (one-dimensional marginal) of B (t)), a special 
case of the CTRW scaling limit where B is a Brownian motion, is the fundamental 
solution to the generalized diffusion equation 


d 1 

where is the integro-differential operator 


X GR,t > 0, 


( 2 . 20 ) 


$tu(t) = 


dt , 


u{s)M it — s)ds 


for a kernel M(t) such that 


£[M(t)](</)) = 


/(</>)■ 


( 2 . 21 ) 


( 2 . 22 ) 


A special case of (12.201) called the fractional Fokker-Planck equation, with M(s) = 
s““/r(l — a) for some 0 < a < 1, was introduced by Metzler et al. [dlj in the 
physics literature, see also Henry et al. 2l|. The extension to a general waiting 
time distribution, and hence a general time-convolution operator , was pioneered 
by Sokolov and J. Klafter [H^ in the context of statistical physics, see also Magdziarz 
[30| , and in the mathematical literature by Magdziarz [29j . This form (12.201) of the 
CTRW limit equation is needed when one wants to add a source/sink term with 
the natural units of x/t, see Baeumer et al. 01 for additional discussion. 

In this work we place these different approaches in a unifying framework by ap¬ 
pealing to the theory of special Bernstein functions. Let / be the special Bernstein 
function (EB) with conjugate (12. 5|) where a* and b* are given by (12.6|) . Assume 
that j^(0, oo) = oo, so that 6* = 0 in view of (12.6|) . As in (I2.3|l . an integration by 
parts in (j2.5ll yields 


poo 

= b* + e-^"P*(s)ds 

Jo 


(2.23) 


which implies that 


/:[p*(t)](0) = = 


f{4>) 


(2.24) 


since /*(<(') = (j)//{(/)). Then we may write 4>tu(t) = ^4'tu(t) where the operator 


4'tu(t) = f u{s)M{t — s)ds, 
Jo 


(2.25) 


and £[4'tu(t)] = f {(j))~^u{(j)) for continuously differentiable functions u. Hence 
(I2.21|) is related to the conjugate Bernstein function /*, while (I2.14p and (12.1611 are 
related to the Bernstein function /. In particular, we have £['DJu{t)] = f{(f))u{(j)) 
and £[4'tM(t)] = so that )D-^4'tu(t) = 4'tT>lu(t) for sufhciently smooth 

functions u. In view of (|2.22l), th is shows that the operator (12.251) is the inverse of 
the operator (12.161) of Toaldo [5l|, when 6 = 0 and M{t) = Then heuristically 

(I2.20p can be seen as the result of applying to both sides of (12.131) with A = 
This will be made precise in Theorem 12.51 Finally, note that we also have 
M{t) = u^i{t) in view of (12.111) . 
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Next we study the eigenstructure of the operator ()2.16|1 . and a corresponding 
property for (|2.17ll . by considering continuous and exponentially bounded solutions 
t M- q{X, t) for A < 0 to the equations 

^/o 0) = Ag(A,t), 

g(A,0) = l, 

and 

^g(A,t) = X-^^J*q{X,s)v*(t-s)ds, 

9(A,0) = 1, 

where v{s) = a + v{s,oo) and u*(s) = a* + v*{s,oo). 
discussion above the operator on the right-hand side of (I2.27|) coincides with the 
operator (12.2111 studied in (sij if z/(0, oo) = oo and M{t) = v*{t). 


t > 0 , 


(2.26) 


^ ^ (2.27) 

Note that in view of the 


Theorem 2.1. Let f be a special Bernstein function having representation (EH) 
with b = 0, u(0, oo) = oo with s —^ u(s) absolutely continuous on (0, oo). Let f* be 
the conjugate of f having representation (12.51) . Let Lf (f) be the inverse ( 12 . 121 ) of the 
Levy subordinator cr^{t) with Laplace exponent f. Then for any A < 0 the unique 
continuous and exponentially bounded solution to (12.2611 is the moment generating 
function 

g(A,t) (2.28) 


and furthermore: 

(1) This solution 1)2.281) to (12.261) is also the unique continuous and exponen¬ 
tially bounded solution to (12.27^ ; 

(2) [0,oo) 9 0 i-A q[—0,t) is completely monotone for each fixed t > 0, and 
( 7 ( 0 , t) = 1 for all t > 0 ; 

(3) t —>■ q{X, t) is completely monotone, for each fixed A < 0, if and only if 
s —>■ u(s) is completely monotone; 

(4) if f{4>) is regularly varying at O-f with some index p G [0,1) then for all 
X<0, 

q{X, t) ^ ^ as t ^ 00 , (2.29) 

a — X 

both t I— q{X, t) and Pft) vary regularly at infinity with index —p, and 

q{X,t)dt = 00 for all A < 0. (2.30) 

Proof. First we prove that (I2.28|l solves (I2.26|l . Since u(0. 00) = 00, [H, Thm 3.1] 
implies that L^{t) has a Lebesgue density x —)> l{x,t). Now [3^ Eq. (3.13)] shows 
that 



C[l(x,-)] {(j)) =C 


d 


dx 


Pr{(T(a:) < •} 


(^) 


and therefore, for 0 > 0, we have Corollary 3.5] 


(2.31) 


l{0,cf) = £[C[l{x,t)]{cl>)]{0) 


fW 1 

cj 0 + /(</>)• 


(2.32) 
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Using the convolution theorem for Laplace transform, and the fact that 5 = 0, 


L 


d f* 

— J q{X, s)iy{t - s)ds - v{t) 


(</>) = [9 * v] {(j)) - 


/(</>) 


=/(</>)9(A, (/>) - 


/(</') 


(2.33) 


Taking Laplace transforms in (j2.26|) and solving for q{X, (p) then yields 

£|,(a,)1W = 7(a,« = M^, 

Comparing (12.321) to (I2.34|) shows that the moment generating function of is 


(2.34) 


pOC 

/ e^^l{x,t) dx = q{X,t) = A < 0. 

Jo 


(2.35) 


Since 1 1 -!> q{X,t) is the same function as [35|, Eq. (3.17)], the proof of [35|, Theorem 
3.1] shows that q{X,t) is a continuous function of t > 0. Then it follows from the 
uniqueness of the Laplace transform (e.g., see Feller [l^ Theorem 1, p. 430]) that 
(12.281) is the unique continuous and exponentially bounded solution to the problem 
(I2.26|) . which proves the first part of the theorem. 

Next we prove Item O- Take Laplace transforms in (12.271) to get 

(j)q{X, (p) -1 = XpC [q * P*] {(p) 

= Xp{cp-^r{P)-b*)q{X,P). (2.36) 

Since /*(<(>) = <('//(<('), and 5* = 0 in view of (12.6L (12.361) can be rewritten 

fW/4‘ 


ui\(p) = 


fW - A 


(2.37) 


which coincides with (12.341) . This proves that (12.281) is also the unique continuous 
and exponentially bounded solution to (12.271) . since they have the same Laplace 
transform. 

Next we prove Item ©■ Since ia(0, 00 ) = 00 , the subordinator ad{t) is strictly 
increasing [^, Theorem 21.5], and hence L-^(O) = 0 a.s. Then we also have q{X, 0) = 
jggAL^(o) _ ^ Since 0 I—> q{—9,t) is the Laplace transform of cc 1 — l{x,t), it is 
completely monotone for each fixed f > 0. 

Next we prove Item ([3|). If the function s P{s) is completely monotone, we 
have that for some measure m(-) and some non-negative constant a 

poo poo poo 

P{s) =a+ e~‘^'“m{dw) =a+ / w e~^'^ m{dw) dy (2.38) 

Jo J s Jo 


and therefore the function 


pOO 

y ^ v{y) = / wm{dw) 

Jo 


(2.39) 


is the completely monotone density of the Levy measure v{dy). This implies that 
/ is a complete Bernstein function. Now [ 4 ^ Thm 6.2 (vi)] implies that 


q}{z) = 


z — X 


(2.40) 
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is a complete Bernstein function for A < 0, and therefore </? o / is a complete 
Bernstein function in view of [i^ Corollary 7.9]. Therefore we have for some 
measure fc(-) that 

poo poo 

ip o f {(/))= c + d(j) + / (l — / e~*^k{ds)dt (2-41) 

Jo Jo 

and therefore, integrating by parts in (12.411) . one has 

-I poo / poo poo 

— {(pof) = J yc + d(j) + J j k{ds) dw 

= J + d(/) + J s~^e~‘^*k{ds)^ dt. 

Since by (12.341) we also have 

-7iP°f)= / e~'^*-q{\,t)dt, (2.43) 

9 Jo 

and since t i-A c + dcj) + k{ds) dw is obviously continuous, it follows 

from the uniqueness theorem for Laplace transforms that 


(2.42) 


pOO 

q{X,t) = c + d(j)+ / s~^e~^^k{ds) 

Jo 


(2.44) 


and if d = 0 this proves that t —>■ q{X, t) is completely monotone, which establishes 
the direct half of Item The fact that d = 0 can be ascertained by observing 
that 

1 , _ 1 /(<^) ^ . 

(j) ^ (j) - X 

as 0 —>■ oo by [i^ p. 23, Item (iv)] and that / > 0, /' > 0, and —A > 0. Then 
/(</)) —>■ L G (0, oo] as ^ oo. Hence 

fiJ)) L 

as<^^oo. 

It follows that d = 0. In view of (12.341) we have 

1 /(<^) 


<t> fW -X Jo 


e ‘^*q{X,t)dt 


(2.45) 


and hence 


G(4,) := 4- 


fW - X 


pOO / pC 

I 


s *‘^k{ds) ) dt 


> + s 


s ^k(ds) 


(2.46) 


which is a Stieltjes function provided that /q°°( 1 + s)“^ s~^k{ds) < oo. But such 
an integral converges since by (I2.44|) and the fact that q{X,0) = I, it must be true 
that 


poo 

I = q(A, 0) =c+ s~^k{ds) 
Jo 


(2.47) 
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and therefore s~^k{ds) is integrable. Now note that F{(j)) = 1/G((/)) is a complete 
Bernstein function by [i^, Thm 7.3]. Then 4>/F{4>) = 4>G[4>) is also complete by 
[ 49 I Proposition 7.1]. It follows that 

1 /(</>) - A ^ A 

is a Stieltjes function in view of [i^ Thm 7.3]. Let g((^) := 1 — X/f{(j)) and use 
(1^ to write 

pOO 1 

gW = T + ^ + / , , Kd'S) (2.48) 

then 

poo -I 

-\lf{4>)=g[(j))-l = - + b-l + I -i—Kds) (2.49) 

9 Jo 9 + s 

and since we know that —\/f{(j)) is non-negative (recall that > 0 and A < 0) 
also (I2.49|) must be non-negative for all (j) S (0, 00 ). In particular by letting cj) ^ 00 
we deduce that b > 1. We have thus proved that is a Stieltjes function. 

Therefore by applying again Thm 7.3] to the Stieltjes function —A// we deduce 
that f{4>) is a complete Bernstein function and therefore 


/(^) =a+ (i ~ J^(s)(is with z/(s) = e ®*m((it) (2.50) 

Jo Jo 

for some measure m and some a > 0 (since we are assuming 6 = 0). From ()2.50ll 
we get that 

v{s) = a+ f h'{w)dw = a+ f ^^ (2.51) 

Js Jo t 

and this proves that s —> P{s) is completely monotone, which establishes the con¬ 
verse part of Item Q. 

Finally we prove Item (j?]). We say that a Borel measurable function / : (0, 00 ) ^ 
[0, cx)) varies regularly at infinity with index p € R if 


lim 

X—>-oo 


fjcx) 

fix) 


(2.52) 


for any c > 0, see for example Bing ham et al. [l3, p. I]. It follows that, for any 
e > 0, for some Xq > 0, we have [1^ Lemma VIIL8.2] 


xP ® < /(x) < for all X > xq. 


(2.53) 


If p = 0, we say that / is slowly varying. If /(1/x) is regularly varying at infinity 
with index —p, then we say that / is regularly varying at zero with index p. Sup¬ 
pose that U{x) is a nondecreasing right-continuous function on [0, 00 ) with Laplace 
transform 

poo 

U{s)= / e-^^U{dx) 

Jo 

for all s > 0. The Karamata Tauberian Theorem [3 Thm XIIL5.I] states that 


C/(x) 


x^L(x) 

r(i + p) 


as X —>■ 00 


U{s)r^ 


where L(x) is slowly varying at infinity and p > 0. 


s-PL{l/s) as s 0, (2.54) 














10 


MARK M. MEERSCHAERT AND BRUNO TOALDO 


Suppose that /(</>) varies regularly at x = 0 with index p = 1 — /3 for some 
(3 G (0,1]. Note that if / varies regularly at zero, we must have p = 1 — /? for some 
P G [0,1] due to the Levy-Khintchine representation (12.11) [l^ Proposition 1.5]. If 
p > 0, it follows from (12.531) that we must have /(0+) = 0, and hence a = 0 in 
dm). If p = 0, then a > 0 is possible, in which case /(0+) = a. In either case, 
from (12.341) we have 




fW 1 

P f{4’) - X 


fW 1 

4> a — X 


as p —^ 0“t“ 


where A < 0, and then it is easy to check that p qiX,^) varies regularly at 
(f> = 0+ with index —/3. Define 


QiX,t) 


q{X, s) ds 


so that 

nOO 

q{XA)= / e"'^*Q(A,dt). 

Jo 

Apply the Karamata Tauberian Theorem to see that t i-A Q{X,t) varies regularly 
at infinity with index /?, and furthermore that 


Q{X,t) 


r(l + /3)(a-A) 


as t —>■ oo. 


Now apply the Monotone Density Theorem [l^, Thm 1.7.2] to see that 1 1 —>■ q{X,t) 
varies regulary at infinity with index /3 — 1, and furthermore tq{X,t)/Q{X,t) —>■ /3 
as t —>■ oo, so that 


q{X,t) 


T{l + P){a-X) 


as t —7- oo. 


(2.55) 


Next observe that (12.3L along with the fact that 6 = 0, implies that fip)/^ is th® 
Laplace transform of Then another application of the Karamata Tauberian 

Theorem shows that 


u{t) 


/3/(lA) 


as t —?> oo. 


(2.56) 


r(i + /3) 

Combining (I2.55|) and (12.561) shows that (o — X)q{X,t) ~ D{t) as t ^ oo, which 
proves the first statement of Item (|T|) . 

Finally, since t ^ Q{X,t) varies regularly at infinity with index /I > 0, it follows 
from (I2.53P that Q{X,t) —)■ oo as t —)• oo, which proves the second statement of 
Item (HI). □ 


Remark 2.2. If s — )• v{s) is completely monotone, then we showed in the proof 
above that 

nOO nOO nOO 

D{s) =a+ e~'^'^m{dw) = a+ / m{dw) dy (2-57) 

Jo J s Jo 

and therefore the Levy density of v is also completely monotone. The corresponding 
Bernstein function / is thus a complete Bernstein function. Therefore the adjoint /* 
is also complete (Proposition 7.1 in [i^) and has a Levy density which is completely 
monotone with tail 

poo poo 

P^is) =a*+ / / e~^'^m{dw) dt 

J s Jo 

















11 


= a* + 


f 




m{dw) 


(2.58) 


for some measure m. Therefore s is a completely monotone function and 

Item (l3|) of Theorem [2T] may be restated as: the function t —>• q{X,t) is completely 
monotone if and only if s —^ is completely monotone. That is, D is completely 

monotone if and only if P* is completely monotone. 


Remark 2.3. It follows from [35|, Theorem 3.1] that the inverse subordinator (12.1211 
has a probability density 


l{x,t) = / iy{t — s)fi{ds,x) 

Jo 


for any t > 0, where ^{ds,x) is the probability distribution of the subordinator 
CT-^(x) with Laplace symbol (EU, and z/(s) = a + v{s, oo). It follows that we can 
also write 


n oo 

— s)fi{ds, x) 


dx 


(2.59) 


in view of (|2.28|) . 


Generalized relaxation equations and patterns have been also examined in [241 : 
H; S lillsil. Kochubei [ 2 ^ considered operators similar to that appearing in 
(|2.26|) but with different kernels of convolution. By making assumptions on the 
Laplace transform of such kernels he determined sufficient conditions for the com¬ 
plete monotonicity of the solution. In 2J; [23 he also studied distributed-order 
relaxation patterns, i.e., the solution to 


r-l Qa 


■u^(a)da = Alt, A < 0, 


(2.60) 


where /i is a non-negative continuous function on [0,1]. He pointed out that in 
this case the relaxation pattern is completely monotone. Observe that (12.601) is a 
particular case of (12.271) (see for details on this point). An important application 
of (]2.60l) is to ultraslow relaxation where /(0) is slowly varying at ^ = 0, see 341 
for more details. 

Remark 2.4. The proof of [sj. Theorem 3.9] provides a partial converse of Item 
O in Theorem l2.1l in the case of ultraslow diffusion. If the tail of the Levy measure 
is of the form 


m = f 

Jo 


t '^p{r])dri 


where p varies regularly at zero with some index a > —1, then v(t) is slowly varying 
34 Lemma 3.1], and then it follows that the Laplace symbol 


f{4>) = [ r(l - T])t ^p{r])dr] 

Jo 


is also slowly varying [3J, Eq. (3.18)]. 
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2.3. Time-changed processes. Theorem 12.11 and the discussion above suggests 
how the approaches of Meerschaert and Scheffler [s^ , Toaldo [Hj , and Magdziarz 
and Schilling 31| may be rearranged under a unifying framework, by resorting 
to special Bernstein functions. Now we extend the equations (12.261) and (12.271) 
to a more general form. Suppose that A is a self-adjoint, dissipative operator 
that generates a Co-semigroup of operators T* on the Hilbert space (ij, (•, •)), and 
consider the generalized abstract Cauchy problem 


d 

dt 


J 9 {s)vit-s)ds -u{t)g{0) = Ag{t) 
or equivalently (as we will show in Theorem 12.Sp 

^g{t) = ^ Ag{s)v*{t-s)ds. 


(2.61) 


(2.62) 


li A = then (12.621) w ith gii) = q{x,t) reduces to the equation (12.201) in 

Magdziarz and Schilling 13ll. 

We follow Kolokoltsov [^, Section 1.9] and Schilling et al. liol . Chapter 12] for 
the basic theory of semigroups and generators. See Jacob [221 Chapter 2] or [H, 
Chapter 11] for a nice summary of the classical theory of linear self-adjoint operators 
on Hilbert spaces. By the definition of a Co-semigroup we have for all rt G that 

(1 ) Tom = u 

( 2 ) TtTsU = Tt+sU 

(3) limt^o \\TtU - u\\^ = 0. 

Note that since H is a self-adjoint generator and it is dissipative we have that 


49 


the spectrum is non-positive, i.e. for any u G Dom(H) we have {Au, u) < 0 
Proposition 11.2 and formula (11.4)], and we can apply the spectral theorem 
Thm 11.4]. Therefore we know that there exists an orthogonal projection-valued 
measure 


E{B) := [ E{dX) 

J B 


(2.63) 


for Borel sets B CM., supported on the spectrum of A and therefore in this case on 
a subset of (—oo,0], such that given a function 


: (- 00 , 0 ] 


we may write Eq. (11.10)] 


E{A)u = f E{X)E{dX)u 

J ( — 00,0] 

for u G Dom(S(H)), where by [i^, Eq. (11.11)] we have 

Dom(S(H)) = < M G ij : f \E{X)\^{E{dX)u,u) < oo > . 

( ./(-oo,0] J 


(2.64) 


(2.65) 


( 2 . 66 ) 


Therefore given any u G Sj we can write 


Ttu = e^*u = 


' ( — 00 , 0 ] 


e^*E{dX)u. 


(2.67) 
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Then for all n € ^ we have 

mu\\^ = 


[ e^*E{dX)u 

< 

j E{dX)u 

J ( — 00 , 0 ] 


J ( — 00 , 0 ] 


= M 


So ’ 


( 2 . 68 ) 


so that Tt is a contraction semigroup (e.g., see Exam ple 11.5]). Since Tt is a 
Co-semigroup we also know that for u S Dom(A) we have 28|, Thm 1.9.1] 


dt 


TfU = ATfU = TtAu 


(2.69) 


and that the map t —>■ Ttu is the unique classical solution to the abstract Cauchy 
problem 17], Proposition 6.2] 


f ftdit) = Ag{t), 
[5(0) = u. 


(2.70) 


Theorem 2.5. Let f andq{X,t) be as in Theorem, \2. A Letx —>• l{x,t) be the density 
of inverse process (12.121) of the subordinator it) with Laplace symbol f. Let Tt 
be a Cq- semigroup on the Hilbert space (Sj, (■, ■)) whose generator A is self-adjoint 
and dissipative. The unique solution to (12.611) on io subject to g(0) = u € Dom(A) 
coincides with the solution of (I2.62[) . This solution is the function q{A,t)u defined 
in the sense of (I2.65|) for all u G Sj, and we also have 


q{A^t)u = / Tsul{sA) 

Jo 


(2.71) 


a Bochner integral on Sj. 

Proof. Using the “functional calculus” approach introduced above we define 

q{A,t)u = f q{X,t)E{dX)u. (2.72) 

J ( —C!O,0] 

Now we recall from Theorem [Q that the function [0, 00 ) 9 0 —)• q{—9,t) is com¬ 
pletely monotone and may be written as the Laplace transform of the density 
X —>• l{x,t) of the inverse process (12.121) of the subordinator {t) with Laplace 
symbol /. 

Therefore (I2.72p becomes 


q{A,t)u = / q{XA)E{dX)u 

J ( — 00 , 0 ] 

/* 

e^^ l{s, t) ds E{dX)u 
E{dX)ul{s, t) ds 


' ( — 00 , 0 ] J 0 


10 J{ — <x>,0] 

poo 

/ Tsul{s,t)ds 


(2.73) 


by (12.671) . Note that (12.731) holds for any function u G indeed [4^ Example 11.5] 


119 (^, 0 ^ 11 ^ = 


Tsul{s, t)ds 


< 


IITsmIL l{s,t)ds < ||u]| 


(2.74) 
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using (12.6811 along with l{s,t)ds = 1. The fact that q{A,t) maps Dom(A) into 
itself may be ascertained by observing that for u G Dom(A) 


Aq{A,t)u = / XE{dX) / q{n,t)E(d^) 

J{ — OO,0] J ( — 00,0] 


(— 00 , 0 ] 


( — 00 , 0 ] 
Xq{X, t)E{dX)u 


' (— 00 , 0 ] 


q{n,t)E{dn) 


' ( — 00 , 0 ] 


XE{dX)u= q{A,t)Au 


(2.75) 


where we used the fact that for all Borel sets B,B' it is true that E{B)E{B') = 
E (B n B') and that E{B) maps Dom(Al) into itself [i^ Thm 11.4]. The fact that 
q{A, t) solves (12.611) and (12.621) can be ascertained as follows. By using again (12.651) 
and Theorem [2T] we have that 
d r* 

— J q{A,s)v{t - s)ds - v{t)q{A,0) 

= f ~r i q{^} s) P{t — s) ds E{dX) — f I/{t)q{X,0)E{dX) 

J[ — 00,0] Jo J{ — oo, 0 ] 

= - s) ds - v(t)q{x, 0)^ E{dX) 

Xq{X, t)E{dX) 


J { — oo,0] 

= Aq{A,t) 


(2.76) 


as well as 

^q{A,t) = f ^q{X,t) E{dX)u 

d(-oo,0] fE 

= f ^ f Xq{X,s)i'*(t — s)ds E{dX)u 

J{-oo,0] dt Jo 

Aq{A,s)v*{t — s) ds. (2.77) 

Finally we prove uniqueness. From Eq. (5.13)] it follows that, for any 
u G Dom(A), the solution q{t) of the generalized Cauchy problem 

^{q = Aq- g(0)=u (2.78) 

has Laplace transform {t i-G X) 

9 (A) = (/(A)-A)-iM^. (2.79) 

In view of (12.171) the generalized Cauchy problem (|2.78l) is another way to write 
(12.611) . and hence (12.791) also holds for any solution t o (12.611) . for any u £Dom(A). 
The remainder of the argument is due to Baeumer [^. Since A generates a Co- 
semigroup, the resolvent (/(A) — A)~^ is a bounded operator for all /(A) in the 
right half plane. In particular (/(A) — A)“^0 = 0 and hence by the uniqueness 
of the Laplace transform, we have q = 0 for initial data u = 0. Then, given two 
solutions qi,q 2 to (12.781) . their difference q = qi — q 2 solves (12.781) with u = 0, and 
hence qi = (? 2 - Therefore, the solution to (12.611) is unique. An argument similar to 
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(j2.37|) shows that the solution to ()2.62|) for any u G Dom(A) has the same Laplace 
transform (j2.79|) . hence it is also unique. □ 

Remark 2.6. Fractional Cauchy problems of the form (12.1511 with p{x, 0) = Hx) G 
Dom(A) were considered by Bazhlekova Q and Baeumer and Meerschaert Q. In 
this case, we have f{cj)) = for some 0 < /3 < 1. Distributed order fractional 
Cauchy problems with 

f{(j,) = f (j,/^p{p)d^ 

Jo 

were considered by Mijena and Nane and Bazhlekova Solutions to the 
generalized Cauchy problem (12.131) . which is equivalent to (12.611) or (12.621) . were 
developed by Toaldo (sH . 


3. Semi-Markov Dynamics 

In this section we construct a semi-Markov process (EH) on a countable state 
space whose dynamics are governed by the operator equations 

^ lo -s)ds - i>it)g{0) = Ag{t) (3.1) 

and 

^d{t) = Ag{s)v*{t-s)ds (3.2) 

where A is an |iS| x |iS| matrix (we allow a countably infinite state space |iS| = oo) 
and g{t) = q{A^ t) is the operator of Thm 12.51 defined by (12.7211 using functional 
calculus. We will work all throughout this section under the following assumptions. 

Al) X{t) is a continuous-time Markov chain with countable state-space S, gen¬ 
erated by A and associated to the semigroup of matrices We 

assume that A is symmetric, and that for its elements aij it is true that 
sup{—ttiy} < oo. The assumption sup{—a^y} < oo implies that X{t) is 
non explosive Hi Thm 2.7.1]. Furthemore within such a framework it is 
true that Pt solves the so-called Kolmogorov backward equation [13, Thm 


II 

(3.3) 

and also the forward one [3, Thm 2.8.6] 


—P^ = p^A, 
dt 

(3.4) 


both subject to Pq = 1. If 5 is hnite then A is a finite matrix (hence 
A is bounded) and the representation Pt = is true. Since we do not 
assume that S is finite (but only countable) we can use the fact that A is 
symmetric and therefore the representation Pt = is true in the sense of 
(I2.65[l which becomes in this case 

Pt = (3.5) 

j 

where Xj are the eigenvalues of A and the Vj are a orthonormal basis of 
eigenvectors of A. 
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A2) Yn is a (homogeneous) discrete-time Markov chain on the countable state 
space <S with symmetric transition matrix H and we denote by hij the 
elements of H. 

A3) Ji are i.i.d. r.v’s with c.d.f. Fj{t) = 1 — q{X,t) where t —>■ q{X,t) is 


completely monotone by Thm l2.ll Assume also that the conditions of Item 
|4]are fulfilled. We define T„ = X]r=i 


Y{t) = Yn, for Tn<t < Tn+l 


(3.6) 


and assume that the i.i.d. r.v.’s Ji are also independent from Yn and there¬ 
fore Tn and Yn are independent. Observe that limi_^oo Fj{t) = 1 — a and 
if a > 0 Fjit) is not a possibly defective c.d.f.. For the sake of simplicity 
we work with a = 0. We also assume that A is strictly negative because if 
A = 0 the r.v.’s Ji become degenerate constant r.v.’s assuming value zero. 

A4) With (T^ {t) we denote the subordinator with Laplace exponent (12.111 for 
6 = 0. Since in A3) we assumed that t — q(X, t) is that of Thm l 2 . 1 ] land is 
completely monotone) we must have that u( 0 , oo) = oo and that s —^ z/(s) 
is completely monotone. Given a subordinator t > 0, with Laplace 

symbol / we denote the inverse process (|2.12|) hy t > 0. Furthermore 

we assume that f{(p) is regularly varying at 0 - 1 - for some index p € [ 0 , 1 ) and 
therefore by Item 3] of Theorem 12.II the functions t —>■ u(t) and t —>■ q{X,t) 
are regularly varying at infinity with index —p, and EJ^ = oo for all i. 

Note that equations and dSH) generalize the Kolmogorov backward equation 
(13.31) to semi-Markov processes. The corresponding generalizations of (13.41) are 



(3.7) 


and 



(3.8) 


Corollary 3.1. Let A be as in Al). The matrix q{A,t), defined in the sense of 


(12.651). where a(X.t) is the function of Theorem\2. 1\ is the uniaue solution to (I33D 
and (I3J1) as well as (1321) and (1321) with initial datum g(0) = 1 (identity matrix). 
Furthermore we have, using the Bochner integral, that 



(3.9) 


Proof. This Corollary is a direct consequence of Thm l2.5l To clarify the arguments, 
here we provide some details where the proof becomes simpler in the present case. 
Observe that now the generator A is a matrix with non-positive eigenvalues and, 
for an orthonormal basis Vj of eigenvectors of A, the spectral representation ()2.65l) 
here is the matrix 


2(A) = '^^{Xj)vjv'j. 


3 

The function q{A^ t) is therefore the matrix 


<l{A,t) = '^q{Xj,t)vjv'j 


3 


(3.10) 
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pOO 

= / e^^'^l{s,t)dsVjVj 

j -^0 

Ps l{s,t)ds. (3-11) 

It is clear that equation (ITtI) is also satisfied since PtA = APt. In our case this 
may be easily checked 



Aq{AA) 


which finishes the proof. 


/ 


= AjWjw'/ e^'^l{s,t)dsviv: 
j z “'o 

poo _ 

= / \je^^^VjV^Viv[ l{s, t)ds 

Jo 

j I 
pOO 

= ^ / Xje^^^VjVjl{s,t)ds 
j -^0 

^OO 

= / e^^^Vjv'jl{sA)ds'Y^XiViv[ 

. Ao 


= q{A,t)A 


(3.12) 

□ 


Theorem 3.2. T/ie process Y(t) introduced in AS) is semi-Markov and such that 
the |5| X |iS| matrix with elements 

q ,^,{ t ) = p{y(t)=j|y(o) = *} (3.13) 

satisfies dSU and (ITtI) as well as (IQ) and ( 1 ^ with initial datum g(0) = 1 for 
A = — where H is the transition matrix of the discrete-time Markov chain 

Yn on S introduced in A2). Furthermore 

poo 

( 9 mW)zj = q{At) = J e~^^^~^'>‘‘l{s,t)ds (3.14) 

where q{A, t) is the function of Thm \2.5] and s —>■ l(s, t) is the density of the process 
[t) in Af). 

Proof. First note that since Y{t) = Yn, for Tn < t < Pn+i, we have that Y{t) = 
where 

N''{t) = max{n G N : T„ < t} (3.15) 

and therefore Y(f) is a semi-Markov process since 

P{Yn=3,Jn < t\ (To,?!)) •• • (r„_i,r„_i)) = P{Yn=3\Yn-i =*)(!- q{X,t)) 

(3.16) 

due to the independence between the r.v.’s Ji and the chain Yn- Therefore the qij 
satisfy the (backward) renewal equation [l^, Chapter 10, formula (5.5)] 

dijit) =qi\t)Si,j f qi^j{s)fj{t - s)ds (3.17) 

les 

where hij are the elements of the symmetric transition matrix P[ of the discrete¬ 
time chain. 
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Next we prove that t —?► qi,j{t) is continuous. Since t 9 (A,t) is completely 
monotone under A3), we can write 


9(A,<) = [ 

Jo 




(3.18) 


i(dw). 


for some measure m{dw), and hence we also have 

fjW = ^(l-'?(A,i)) e- 

Then (j3.17ll yields 

pt _ pCO 

=g(A,t)d*j + / '^hi^iqij{s) / e~m{dw)ds. 
Jo Jo 


(3.19) 


les 


les 


e-(*+^-*)“'m(dw)ds 


Since f^i,iqi,j{w)\ < since fj(0) is a positive and decreasing 

function, it follows that for any i,j € S and h> 0 we have 

h,j{t) -qi,j{t + h)\ 

nt _ poo 

< |g(A,t) - g(A,t + h)| + / '^hi,iqij{w) {l - e~*^) m{dw)ds 

Jo ,^o Jo 

pt-\-h _^ p 

+ / / 

Jt Jo 

<q{X,t) — q{X,t + h)+ f {q{X,t — s) — q{X,t + h — s)) ds + fj{0)h. (3.20) 

Jo 

Then the first and the last terms in (13.201) go to zero as h —>• 0+ while for the 
integral we note that 


{q{X, t — s) — q{X, t + h — s)) < q{X, t — s) 


(3.21) 


and J* q{X,t — s)ds < oo for alH < oo. Therefore the integral in (I3.20|) goes to zero 
as h ^ 0+ by dominated convergence theorem. For h < 0 the argument is similar. 
Hence t qi,j(t) is continuous. 

Therefore the qi,j{t), i,j G <S, are the unique continuous functions whose Laplace 
transforms satisfy (we here use (|2.33l) and (13.171) 1 


~ f4.\ x U ~ (J.\ ^ 

= -77T\ - 


/(<(>) - A 


i&s 


/(<(>)-A' 


(3.22) 


Now multiply by f{(j)) — A on both sides of (13.221) and substract qi j(0) = Sij to get 
f{4')qi,]{(f) - ^^^9»j(o) = -A -q^,jw'^ ■ (3-23) 

Now multiply by /*(<()) = J)/ f(4>) to got 


- <?ij(0) = -Xf*{(t>) '^qij{4))h^^i - qi,j{<t)) . 

\ies / 


(3.24) 






















19 


By Laplace inversion of (13.2311 and (I3.24|) we have using (12.31) that qij{t) satisfies 
for all i,jGS 

I Tt Jo J (s) - s)ds - (0) = -A <li ,3 it)Ki “ j ( 0 ) (^3 25) 

1 <?ij (0) = 5iJ 


and 


fo (Sies - lijis)) - s)ds 

= dij. 


(3.26) 


Note that the solution to the matrix problem, for A = —X{H — 1), 

I ft fo s) - s)ds - v{,t)q{A, 0) = Aq{A, t) 
U(A0) = 1 


is a matrix such that each entry satisfy the backward equation (I3.25p . The backward 
equation therefore is proved. 

The forward equation follows by (12.751) or (13.1211 . To verify in this special case, 
since H is symmetric then so is iL — 1 and the eigenvalues of iL — 1 are non-positive 
since iJ is a transition matrix. Therefore we can write as in ()3.1ip 

poo 

q-x(H-i){t) = / (3.28) 

Jo 

and we know that 


—\{H — l)g-A(ff-i)(0 — q-x{H-i){t){—X){H — 1) 
in view of (j3.12ll . 


(3.29) 

□ 


If we interpret the i.i.d. r.v.’s Ji as waiting times between events in some point 
process then the sequence Ji is a renewal process and the r.v. is the instant of the 
n-th event. The process counting the number of events occurred up to a certain time 
t is the counting process N'^it) = max{n €N : < t}. Clearly if one considers 

exponentially distributed waiting times then the corresponding counting process 
is the Poisson process. When the waiting times are Mittag-Lefller distributed, i.e. 
P {J > t} = Ea{Xt°‘), a € (0, 1), A < 0, a particular semi-Markov model on a graph 
have been considered in |19l : l45l | . The authors showed that the governing equation 
is time-fractional. In general if the i.i.d waiting times Ji have finite mean /ij then 
one has by a simple argument using the strong law of large numbers that a.s. 


lim 

t—¥oo 


N^t) 

t 


1 

JJ 


and the elementary renewal theorem [3, Proposition 1.4] states that 


(3.30) 


lim - 

t —>00 t 


1 

Jj' 


(3.31) 


These facts may be interpreted as an equivalence (in the long time behaviour) 
between the Poisson process and a general renewal process with finite-mean waiting 
times. Note that (13.301) and (13.311) means that if EJ^ < 00 then as t —>■ 00 we 
have, a.s., N{t) ^ N^{t). This heuristically means that a renewal process with 
finite mean waiting times is indistinguishable after a “long time” from the Poisson 
process. Therefore when you observe the process Y(t) defined in A3) with sojourn 
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times Jn = Tn +1 — Tn having finite mean then, after a transient period it behaves 
like the case in which Tn+i — are exponential r.v.’s. 

We have here introduced a class of renewal processes associated with waiting 
times J such that P {J > t} = q{X,t) and under A3) we know that EJ = oo. 
Therefore they never behave as a Poisson process. Corollary 13.11 and Theorem 13.21 
implies that the time-changed Markov chain X (T'f(t)), < > 0, may be equivalently 
constructed starting from an embedded Markov chain T„ and by inserting between 
jumps the heavy-tailed waiting times Ji. 

In equation (13.61) we defined the renewal process Y{t) that jumps to the state 
Yn for the underlying discrete time Markov process at the arrival time T„ of the 
renewal process with waiting time distribution P[J > t] = q(X,t). Then we have 
Y{t) = yNi’(i), a time change using the renewal process ()3.15|1 . Next we show 
that the same process can also be constructed by a time change using the inverse 
subordinator (I2.12|) . 


Proposition 3.3. Let N(t) be a homogeneous Poisson process with rate 6 = 
—A. The time-changed process N (^L^{t)^ and the process N’^{t) are the same pro¬ 
cess. Hence the semi-Markov process (1^ is the same process as the time-changed 
Markov chain AAr(Lr(t))- 


Proof. This is a consequence of [36j, Thm 4.1] since P {Ji > t} 
and in view of Thm 12.1] it is true that q{X,t) = Ee''*^ 


q{Xj) for any i 
□ 


3.1. Classification of states. We here investigate whenever a state i is transient 
or recurrent for the semi-Markov process by making assumptions on the 

embedded chain Yn. We recall that a state i is recurrent if 

P (the set {t > 0 : Y{t) = i} is unbounded | F(0) = i) = 1 (3.32) 

and is transient if the probability in (I3.32[) is zero. Since we take the probability of 
a tail event, 0 and 1 are the only possibilities. We have the following result. 


Theorem 3.4. Under A2), AS), and Af) it is true that 

(1) If the state i is recurrent for Yn then it is recurrent for Y{t) 

(2) If the state i is transient for Yn then it is transient for Y(t) 

(3) = oo independently from the fact that the state i is transient 
or recurrent. 

We recall that qi^ift) = P {Y{t) = i \ Y{0) = i} = P® {Y(t) = i}. 


Proof. Note that in view of Proposition 13.31 we can write 

y{t) = = lV(L/(t)). (3.33) 

Since t i—!> (t) is a.s. right-continuous, unbounded, and strictly increasing, it 
follows from the change of variable formula in Meerschaert and Straka [s^, p. 1707] 
that 




>> 0 : 


K, 






dt 


poo 

n T„<t<T„+i 


(3.34) 
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where e{t) is the Poisson point process underlying the subordinator cr-^ with char¬ 
acteristic measure v{s)ds. Note that if the state i is recurrent for Yn then 

P (Yn = i for infinitely many n) = 1 (3.35) 


and the number of summands in (13.341) is a countable infinity. Furthermore the 
sequence 

E ( 3 . 36 ) 

Tn<t<Tn + l 


is a sequence of i.i.d. r.v.’s since e{s) is a Poisson point process. Therefore (13.341) 
is the sum of a countable infinity of i.i.d. positive r.v.’s. which diverges with prob¬ 
ability one. This proves Item[TJ If instead the state i is transient, then the number 
of summands in (j3.34l) is finite, and since our subordinators are here assumed to 
be not subject to killing, it is true that for all 0 < < ^2 < oo 

0 < E ^('S) < oo a.s. (3.37) 

ti <S<t2 


and the sum (13.341) is finite since it is the sum of a finite number of hnite summands. 
This proves [5] Observe now that 


qi,i(t)dt =E*/ l[Y{t)=i}dt 


> E® Ji = oo 


and this proves Item [3] 


(3.38) 

□ 


It is instructive to compare Part (3) of Theorem 13.41 with the well-known char¬ 
acterization of transient and recurrent states in a semi-Markov process with finite 
mean waiting time between jumps, using the occupation measure (or 0 -potential) 
[l5| . The semi-Markov process is formed by inserting a random waiting time Ji 
before jumping from state to state Yi in the underlying Markov chain. Hence 
the number of times the process returns to its starting point is not affected. Hence 
the state is recurrent for the semi-Markov process if and only if it is recurrent for 
the underlying Markov chain. If the occupation times (waiting times) in each state 
have a finite mean, then the total expected occupation time in the starting state is 
proportional to the number of visits. This happens if and only if qi,i{t)dt = oo. 
However, when the waiting times between state transitions are heavy-tailed with 
infinite mean, the mean time spent in the starting point by the process is always 
infinite. 


4. Examples 

In this section, we provide some practical examples, to illustrate the application 
of the results in this paper. 

Example 4.1. Consider a CTRW with iid particle jumps X„ independent of the 
iid waiting times Wn- Then a particle arrives at location S{n) = Xi -I- • ■ • -I- Xn at 

time Tn = Wi-\ - \-Wn. If E[X„] = 0 and E|X^] < oo, then n~^/'^S([nt]) B{t), 

a Brownian motion, by Donsker’s Theorem [l6|, Theorem 8.7.5]. If P[IFn > = 

t~d/r(l — P) for some 0 < /3 < 1, then ^ i ^ /3-stable subordinator 

with Laplace symbol f(4>) = (j)^ [^ . Theorem 3.41]. The number of jumps by time 
t > 0 is Nt = max{n > 0 : T„ < t} and a simple argument [s^ Theorem 3.2] shows 
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that this inverse process has an inverse limit n ^Nnt => Lt where the inverse stable 
subordinator l{ is defined by (12.121) . Then we have 

n-^/^S{N,,t) « ■ n-^Nr^t) « Sin^ l{) ^ B{l{) 

as n —>■ oo, see [H, Theorem 4.2] for a rigorous argument. The probability density 
p{x, t) of the limit process B{l{ ) solves the time-fractional diffusion equation (12.131) 
with Cf{dt) = , a Caputo fractional derivative of order 0 < /3 < 1, and A = Dd'^ 

where D = E[X^]/2, see [s^ Theorem 5.1] and 37, Eq. (1.8)]. Since the Caputo 
fractional derivative [s^, Eq. (2.16)] 


dtP{x,t) = 


1 


d 


m-P)Jo dt 

is related to the Riemann-Liouville fractional derivative [fi 

1 d 




r(i -p)dt, 


p{x,t — u)u ^du 

^ Eq. (2.17)] 
/ p{x,t — u)u~^du 

Jo 


by [371, Eq. (2.33)] 


]p{x,t) -p(a;,o)- 


t 


we can also write the governing equation (I2.13|) in the form 

t-P 

= A p(x,t)- 


^tP(x,i) -P(x,0)- 


(4.1) 


(4.2) 


'r(i-^) 

The Laplace symbol /(</>) = 4>^ can be computed directly from (|2.1D with a = b = Q 
and v{dt) = 0t~^~^dt/T(l — jd) using integration by parts and the definition of 
the Gamma function (^, P roposition 3.10]. Then ^[t) = t“^/r(l — jd) and the 
operator T)^ of Toaldo ^ defined by (I2.16P reduces to the Riemann-Liouville 
fractional derivative. Similarly, the operator Sf of [5l[ defined by (12.171) reduces 
to the Caputo fractional derivative. Then the governing equation ()2.61|) of Toaldo 
with g{t) = p{x, t) reduces to ()4.2I) . Since the conjugate Bernstein function = 
J’/fW = ^ the same calculation as for / shows that y*{t) = /T{(d), and 

then the operator of Magdziarz defined by (I2.2ip with M{t) = v*{t) is the 
Riemann-Liouville fractional integral 

^tP{x, t) = p{x, t - u)u^-^du = p{x, u){t - uf-^du 

of order fd [s^, P- 250]. Then the governing equation (12.621) of Magdziarz 311 with 
g{t) = p(x, t) reduces to 

= (4.3) 


Since ^ we can also write (14.31) in the form 

^P{x,t) = Ap{x,t) = AJ}\~'^p{x,t), 

which is commonly seen in applications [2l|; . The heuristic derivation of (14.31) 

is to simply apply the operator to both sides of (1121), or the equivalent form 

d^p = Ap, but the initial condition requires some care. 
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Example 4.2, Replacing the iid jumps Xn in Example 14.11 with a convergent 
triangular array, we obtain a limit B(l{) where B{t) is an arbitrary Levy process 


32 


[35|, Theorem 3.6] with generator A given by the Levy-Khintchine formula 
Theorem 3.1.11]. Then all the results of Example 14.11 hold with A = Dd^ replaced 
by this Levy generator, in or in for any finite dimension d [s^ Theorem 
4.1]. The same is true more generally for Markov generators A, where the jump 
distribution depends on the current state 27], Theorem 4.2]. 


Example 4.3. For a CTRW with deterministic particle jumps Xn = 1, and the 
same waiting times Wn as in Example 14.11 we have S{n) = n and the CTRW 


S{Nt) = Nt converges to the inverse stable subordinator: n ^Nn 


-/ 


The 


probability density l{x,t) of lA solves the time-fractional equation (12.131) with 
Cf{dt) = df and A = —dx Eq. (5.7)]. Several equivalent governing equa¬ 
tions for the inverse stable subordinator l{ are also discussed in [s^, including 
equation (12 611) of Toaldo [Hlj (see [H, Eq. (5.9)]) and equation (12.621) of Magdziarz 
31 | (see [3^ Eq. (5.18)]) with g{t) = l{x, t) and A = —dx- In this case, the moment 


generating function (I2.28|) can be written explicitly as in terms 

of the Mittag-Leffler function 




j=0 


r(i + /3j) 


(4.4) 


for any A < 0, see Bingham llj. The function g(A, t) solves (12.261) . which can be 
rewritten in this case as 




r(i-/3) 


= Ag(A,t), 


or equivalently, using grj, 


as 


= Xq{X,t)- 


That is, the moment generating function of the inverse stable subordinator is an 
eigenfunction of the Caputo fractional derivative. The function q{X,t) also solves 
(I2.27|) . which can be rewritten in this case as 

^q{X,t) = ADt"'^g(A,t). 

dt 

Here f{(j)) = varies regularly at zero with index /?, D{t) = /T{1 — /?) varies 

regularly at infinity with index —/3, and Item (|4|) of Theorem 12.11 shows that t i-)- 
q{X, t) also varies regularly at infinity with index —jd, with q[X, t) ~ A“^t“^/r(l—,3) 
as t ^ oo, compare Scalas [13, Eq. (24)]. The potential measure (dt) has 
Laplace-Stieltjes transform l//(0) = 4’~^ [R Eq. (5.12)], and inverting 37, Eq. 
(2.25)] shows that (12.101) holds with c = 0 and u^f{t) = Then it follows 

from [49|, Thm 10.3] that / is a special Bernstein function. In fact /*(</<) = (lA~^ 
from (12.51) with a* = b* = 0 and v*{dt) = (1 — j3)t^~‘^dt/T{l3) concentrated on 
t > 0. Note also that [i^, Eq. (10.9)] u^jit) = v*{t). 

Example 4.4. Let v{dt) = j3t~dt/T— /3) for some 0 < ,3 < 1 and c > 0 
and compute 

noo 

f{(j)) =c'^+ (l - v{dt) = {({> + c)^ 

Jo 


(4.5) 
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using integration by parts, compare 37, Eq. (7.9)]. Then a{ is a tempered stable 
subordinator [s^, Section 7.2] killed at rate c^: If D{t) is a tempered stable subor- 
dinator with = exp[—1{((^ + c)^ — c^}] and S is an exponential random 

variable independent of D(t) with P[S' > t] = exp[—c^t], then we can let 




if t < S' 
if t > S 


and it is easy to check that / is the Laplace symbol of this process. Now 

/3 


i'{t) = a + v{t,oo) = c^+ 


r(i-/3) 




(4.6) 


involves the incomplete Gamma function, which cannot be written in closed form. It 
is well known that (j)^u{(j)) is the Laplace transform of ID)fM(t) [^, p. 39]. Using the 
shift property u{4> + c) = £[e““‘u(t)] twice, it follows that the tempered fractional 
derivative IDf’^n(t) = (e''^*u(t)) has Laplace symbol /, i.e., ’“^(t)] = 

{cj) + c)^u{cj)), see [37|, p. 209]. If u,v/a.re in L^(IR) then one can write the tempered 
fractional derivative explicitly as Theorem 2.9] 




r(i - P) 7-00 {t - u)p+^ 


It follows from (12.1811 that u{t) = ID)f’°u(t), and hence the governing equation 
(I2.6ip of Toaldo can be written in the form 


- i^(Off(0) = Ag{t). 

Recall that £[t^“^/r(/3)] = 4’~^, and use the shift property again, along with (I2.22L 
to see that 

Then the operator of Magdziarz and Schilling [sij defined by (12.211) can be 
written as 


= iw) L 


dtT{P) Jq 

where appears the tempered fractional integral [ic 


:= 


r(^) 


/ u{t — s)s 

Jo 




and hence the governing equation (12.621) of Magdziarz [3lj reduces to 


(4.7) 


The potential measure {dt) has Laplace-Stieltjes transform !//(</)) = {(j) + c)~^ 
( 4 ^ Eq. (5.12)], and inverting shows that (12.1011 holds with c = 0 and = 

Mit) = u*{t) = t^“^e“°*/r(/3). Then it follows from [i^, Thm 10.3] that / is a 
special Bernstein function. It is easy to check that f{4>) = (<() + c)^ varies regularly 
at zero with index /3 = 0, and then Item (|T|) of Theorem 12.11 shows that both v{t) 
and 1 1 —^ q{\, t) are slowly varying at infinity. 
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Example 4.5. The (unkilled) tempered stable subordinator D{t) related to the 
Bernstein function (c + (j))^—c^ is also included in our framework. The Levy density 
in this case is 


u{t) 


r(i-/ 3 ) 


/3 

r(i-/ 3 ) 


e 


— ct 



e 


— st 


r(TT«*- 


(4.8) 


Since (14.81) is the product of two completely monotone functions, it is completely 
monotone Corollary 1.6]. This means that 


/■oo ct 

(j) ^ + cf - (1 - dt (4.9) 

is a complete Bernstein function by [4^ Def 6.1] and therefore it is also special by 
[ 4 ^ Prop 7.1]. The tail of the Levy measure here is similar to (14.611 . but without 
the constant term: 


v{t) = 




s-^-ie-“ds. 


Now (12.2211 becomes 


M{t) = C 


-1 


((c + 0)'^ - c^) 


-1 




(4.10) 

(4.11) 


which seems difficult to invert in closed form. Since a* = 0 in view of (|2.6ll , we get 
from (I2.11|) that 


v*{t) = iy*{t,oo) =u„f{t) 


(4.12) 


where u^f (t) is the potential density of the tempered stable subordinator. Since / 
is special, its conjugate + c)^ — c^]“^ is the Laplace symbol of some 

subordinator a*{t). 


Example 4.6. Distributed order fractional derivatives are also included in our 
framework. Let (0,1) 9 y —>■ a{y) be a function strictly between zero and one and 
let p{-) be a measure on (0,1). Choose a{y) and p in such a way that, for s > 0, it 
is true that 



poo 

L '“"‘b 

! XX p{dy)ds 

0 r(l-a(y)) 



pOO 

= / / (sA 

1 dsp{dy) < 00 . 

r(l -a(y)) 

(4.13) 

Under (Pll?| 

v{s) = 

Jo r(l-Q;(y)) 

(4.14) 

is a Levy density and therefore 




poo 

/(</>) = / (1 
^0 

— u{ds) = [ (j)^^^^p{dy) 

Jo 

(4.15) 


is a Bernstein function. The operator (D-f corresponding to (I4.15|l may be viewed 
as a distributed order fractional derivative [12, Remark 4.3] since here 

/■i g-aiv) 

v{s) = / - T-^P{dy) (4.16) 

Jo r(l-a(y)) 
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and therefore 


dt 


i(s) f 

Jo 


^ {t - 

0 r(i-«(?/)) 


p{dy) ds — m(0) 


rl f-oi{y) 

cl ^-a{y) 


L rd-ata)) 


'i>1^^\{t)p{dy) - m(0 ) 


l-a{v) 


'o r(i-«(?/)) 


p{dy). 


p{dy) 

(4.17) 


The traditional form of the distributed order derivative is the special case a(jj) = y. 
Now note that the function t is completely monotone for each fixed y since 

it is the Laplace transform of the measure ds/r{a{y)). Therefore, when a{y) 

and p{-) are such that (14.131) is fulhlled, also the function 


Ht) = [ 

Jo 


1 


0 ^0-a{y))Jo 


1 


^ gOi{v)-^ 

r(a( 2 /)) 

q“(y)-l 


dsp{dy) 


lo r(l - a(?/)) r(a(?/)) 


p{dy) ds 


(4.18) 


is completely monotone. Therefore (14.181) is the tail of a Levy measure with a 
completely monotone density by Remark 12.21 This implies that f i s a complete 
Bernstein function [d^, Def 6.1] and therefore it is also special [4^ Prop. 7.1]. 
Hence 


/*(<^) = 7T 


fo (jj^^^y^pidy) 


(4.19) 


is a (special) Bernstein function, and there exists a subordinator cr* (t) with Fourier 
symbol /*. From ()2.11|) we have 


U*(t) = I/*{t,Oo) =Uap{t) 


(4.20) 


where Uav (t) is the potential density of the subordinator with Laplace exponent 
(I4.15p . Then observe that Items (1), (2) and (3) of Theorem 12.11 apply to this 
case. In particular Item (3) here is in accordance with [M Thm 2.3]. Item (4) 
applies if p and a are such that f{4>) = fg 4’°‘^y'^p{dy) is regularly varying at 0 +. 
For example, if a{y) = y and p(dy) = po{y)dy where pn is regularly varying at zero 
with some index 7 > — 1, then / is slowly varying |34l . Lemma 3.1], and hence P(t) 
and q{X, t) are slowly varying at f = 00 . This is a model for ultraslow diffusion 341 
where a plume of particles spreads at a logarithmic rate in time. Here the kernel 
of Magdziarz and Schilling ^ can be computed from 


M{t) = C 


-1 


l/o (t)^^y'>p[dy) 


it). 


(4.21) 


In the special case /(^) (retarding subdiffusion) one can write 
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where the two parameter Mittag-Lefher function 

oo 


= X! 


r(sn + t)’ 


n—0 


compare Chechkin et al. [IJ, Eq. (16)]. 
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